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METHOD AND SYSTEM FOR ROUTING IP DATAGRAMS 
ACCORDING TO CURRENT BANDWIDTH USAGE 

Technical field of the Invention 

The present invention is directed to computer networks, and more particularly to a 
5 method and system, in an Internet Protocol (IP) network, for routing IP traffic to 
several next hop routers according to current bandwidth usage on links connecting 
these next hop routers. 

Background art 

internet 

10 The Internet is a global network of computers and computers networks (the "Net"). 
The Internet connects computers that use a variety of different operating systems or 
languages, including UNIX, DOS, Windows, Macintosh, and others. To facilitate and 
allow the communication among these various systems and languages, the Internet 
uses a language referred to as TCP/IP (Transmission Control Protocol/Internet 

15 Protocol"). TCP/IP protocol supports three basic applications on the Internet : 

• transmitting and receiving electronic mail, 

• logging into remote computers (the 'Telnet"), and 

• transferring files and programs from one computer to another ("FTP" or "File 
Transfer Protocol"). 

20 TCP/IP 

The TCP/IP protocol suite is named for two of the most important protocols: 

• a Transmission Control Protocol (TCP), and 

• an Internet Protocol (IP). 

Another name for it is the Internet Protocol Suite. The more common term TCP/IP is 
25 used to refer to the entire protocol suite. The first design goal of TCP/IP is to build 
an interconnection of networks that provide universal communication services: an 
"internetwork", or "internet". Each physical network has its own technology 
dependent communication interface, in the form of a programming interface that 
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provides basic communication functions running between tine physical network and 
the user applications. The architecture of the physical networks is hidden from the 
user. The second goal of TCP/IP is to Interconnect different physical networks to 
form what appears to the user to be one large network. 
5 TCP is a transport layer protocol providing end to end data transfer. It is responsible 
for providing a reliable exchange of information between 2 computer systems. 
Multiple applications can be supported simultaneously over one TCP connection 
between two computer systems. 

IP Is an internetwork layer protocol hiding the physical network architecture bellow it. 
10 Part of the communicating messages between computers is a routing function that 
ensures that messages will be correctly directed within the network to be delivered to 
their destination. IP provides this routing function. An IP message is called an IP 
Datagram. 

Application Level protocols are used on top of TCP/IP to transfer user and 
15 application data from one origin computer system to one destination computer 
system. Such Application Level protocols are for instance File Transfer Protocol 
(FTP), Telnet, Gopher, Hyper Text Transfer Protocol (HTTP). 

World Wide Web 

With the increasing size and complexity of the Internet, tools have been developed 
20- to help -find information on the network, often called navigators or navigation 
systems. Navigation systems that have been developed include standards such as 
Archie, Gopher and WAIS. The World Wide Web ("WWW" or "the Web") is a recent 
superior navigation system. The Web is : 

• an Internet-based navigation system, 

25 • an information distribution and management system for the Internet, and 

• a dynamic format for communicating on the Web. 

The Web seamlessly, for the use, integrates format of information, including still 
images, text, audio and video. A user on the Web using a graphical user interface 
("GUI", pronounced "gooey") may transparently communicate with different host 
30 computers on the system, and different system applications (including FTP and 
Telnet), and different information formats for files and documents including, for 
example, text, sound and graphics. 
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IP Router 

One of the basic function of IP is its ability to form connections between different 
physical networks. This is due to the flexibility of IP to use almost any physical 
network below It, and to the IP routing algorithm. A system that does this is termed a 
5 "router". A "Router" is a computer that interconnects two networks and forwards 
messages from one network to the other. Routers are able to select the best 
transmission path between networks. The basic routing function is implemented in 
the IP layer of the TCP/IP protocol stack, so any host (or computer) or workstation 
running TCP/IP over more than one interface could, In theory, forward messages 
10 between networks. Because IP implements the basic routing functions, the term "IP 
Router" is often used. However, dedicated network hardware devices called 
"Routers" can provide more sophisticated routing functions than the minimum 
functions implemented in IP. 

IP Routing 

15 When data is sent to a remote destination, each IP datagram is first sent to a local 
router. An incoming datagram that specifies a destination IP address other than one 
of the local router IP address is treated as a normal outgoing datagram. This 
outgoing datagram is subject to the IP routing algorithm of the router, which selects 
the next hop for the datagram. The router forwards each datagram towards- its final 

20 destination. A datagram travels from one router to another until it reaches a router 
connected to the destination. Each intermediate router along the end-to-end path 
selects the next hop used to reach the destination. The next hop represents the next 
router along the path to reach the destination. This next router can be located on 
any of the physical networks to which the intermediate router is attached. If it is a 

25 physical network other than the one on which the host originally received the 
datagram, then the result is that the intermediate router has forwarded the IP 
datagram from one physical network to another. An "IP routing table" in each router 
is used to forward datagrams between networks. A basic IP routing table comprises 
information about the locally attached networks and the IP addresses of other 

30 routers located on these networks, plus the networks they attach to. A routing table 
can be extended with information on IP networks that are farther away, and can also 
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comprise a default route, but it still remains a table with limited information. A routing 
table represents only a part of the whole IP networks. A router having such a routing 
table is called "a routers with partial routing information". A robust routing protocol 
must provide the ability to dynamically build and manage information in the IP 
5 routing table. As the changes in the network topology may occur, the routing tables 
must be updated with minimal or without manual intervention. 

IP Addressing 

IP addresses are used by the IP protocol to uniquely identify a host on the Internet. 
Strictly speaking, an IP address identifies an interface that is capable of sending and 

10 receiving IP datagrams. Each IP datagram (the basic data packets that are 
exchanged between hosts) comprises a source IP address and a destination IP 
address. IP addresses are represented by a 32-blt unsigned binary value which is 
usually expressed in a dotted decimal format. For example, 9.167.5.8 is a valid 
Internet address. An IP address is divided between a network and a host part, the 

15 first bits of the IP address specifying how the rest of the address is divided. The 
mapping between the IP address and an easier-to-read symbolic name, for example 
myhost.ibm.com, is done by the "Domain Name System" (DNS). 

Routing Algorithm 

In the IP networking, one of the major issue to solve is to route the IP datagrams. 

20 For this reason, a routing table is built In each routing device. Routing tables are 
either statically configured by a network administrator or dynamically configured 
based on information exchanged between routers using routing protocols such as 
Routing Information Protocol -RIP-, Open Shortest Path First -OSPF-, Border 
Gateway Protocol -BGP-, ...). Dynamic routing algorithms allow routers to exchange 

25 route or link information, from which the best paths to reach destinations in an 
Internetwork are calculated. Static routing is generally used to supplement dynamic 
routing. 

The goal of the routing function is to determine for each IP datagram, the next hop 
device in order to reach the final destination. The search for the next hop device is 
30 commonly based on the shortest path or shortest distance in order to minimize the 
transmission delay and resource consumption in the network. 
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Distance Vector Routing 

The principle of Distance Vector Routing is very simple. Each router in an 
internetwork maintains the distance from itself to every known destination in a 
Distance Vector Table. The Distance Vector Table comprises a plurality of 
S destinations (vectors) associated with costs (distances) to reach them and define the 
lowest distances to these destinations at the time of the transmission. The distances 
in the tables are computed from information provided by neighbour routers. Each 
router transmits its own Distance Vector Table across the shared network. The 
sequence of operations for doing this is as follows : 
10 • Each router is configured with an identifier and a cost for each of its network 
links. The cost is normally fixed at 1 , reflecting a single hop, but can reflect other 
measurement taken for the link such as the traffic, speed, ... 

• Each router is configured at the beginning of the process with a distance vector 
table comprising 0 for itself, 1 for directly attached networks, and infinity for every 

15 other destination. 

• Each router periodically transmits its distance vector table to each of its 
neighbours. It can also transmit the table when the table changes. 

• Each router uses the information received from its neighbours to calculate its 
own distance vector table. 

20 • The total cost of each destination is calculated by adding the cost reported to it in 
a neighbour's distance vector table tblhe cost of the link to that neighbour. 

• The distance vector table (the rocrting table) for the router is then created by 
taking the lowest cost calculated for each destination. 

The distance vector algorithm produces a stable routing table after a period directly 
25 related to the number of routers across the network. 

One of the characteristic of the distance vector routing is that the distance is a static 
value pre-configured on each router interface. The distance is mostly chosen per 
default as being the number of hops (equals the number of intermediate routers). 
This means that if, for instance, three intermediate routers are in the path between a 
30 source network and a destination network, the distance from this source network to 
the destination network seen by the router attached to the source network, is three. 
Once a router has found out the shorta^distance to a destination network, he will 
always use this route to reach the destination network. 
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More explanations about the technical field presented in the above sections can be 
found in the following publications incorporated herewith by reference: "TCP/IP 
Tutorial and Technical Overview" by Martin W. Murhammer, Orcun Atakan, Stefan 
Bretz, Larry R. Pugh, Kazunari Suzuki, David H. Wood, International Technical 
5 Support Organization, October 1998, GG24-3376-05. 

Bandwidth Cost 

Most server hosting centers have multiple Internet connections (at least two for 
redundancy reasons) provided by different Internet Service Providers (ISPs). The 
Border Gateway Protocol (BGP) is widely used to route the IP traffic between the 
10 different Internet service providers (ISPs) and the server hosting center. BGP is also 
used to advertise all the Internet routes to the different server hosting centers. For 
instance, the IP datagrams can be routed towards their final destination by the 
routing device, at the front end of the server hosting center, according to the shortest 
path. 

15 However, the shortest path is not always the most appropriate criterion in term of 
business needs. A very important parameter to take into consideration in the Internet 
world is the financial cost of the bandwidth based on the bandwidth usage. The 
standard way for an Internet Service Provider (ISP) to charge his customers (the 
- - - server hosting centers). Js the. so called 95%4ile method. At. regular Jntervals. (for > ^ 

20 instance every 5 minutes), the bandwidth currently used (both inbound and 
outbound traffic) by the customer (the server hosting center) is measured and the 
result is saved by the Internet Service Provider (ISP). At the end of a billing period 
(this period is generally equal to one month), the Internet Service Provider (ISP) 
sorts out all the measurements, removes 5% of the measurements, the 

25 measurements with the highest values, and takes the next measurement as the 
value of the bandwidth used through his network. This value will be the base for 
billing the server hosting center. This bandwidth value has an associated cost 
depending on the range of bandwidth used. For example, a usage between 0 and 10 
Mbps is charged "X" while a usage between 10 and 20 Mbps is charged "Y" (with X 

30 < Y) and so on. 
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In order to optimize the connection costs, the bandwidth usage should represent a 
very important aspect of the routing in a server hosting center and should be a key 
decision factor on top of the traditional routing algorithms based on the shortest 
path. 

Summary of the invention 

The present invention is directed to a method, system and computer program as 
defined In independent claims for selecting, in a router In an IP network, a next hop 
router among a plurality of next hop routers according to bandwidth usage of links 
connecting said plurality of next hop routers. The method comprises the steps of : 

• receiving a datagram comprising a destination network address; 

• identifying a next hop router associated with said destination network address; 

• determining whether or not the transmission of the datagram on the link 
connecting the next hop router would result for a current bandwidth usage in 
exceeding a current bandwidth threshold associated with said next hop router: 

if the transmission of the datagram on the link connecting the next hop router, would 
not result for the current bandwidth usage in exceeding the current bandwidth 
threshold associated with said next hop router; - « - 

• updating the current bandwidth usage associated with the next hop router; 

• transmitting the datagram to the next hop router; 

if the transmission of the datagram on the link connecting the next hop router would 
result for the current bandwidth usage in exceeding the current bandwidth threshold 
associated with said next hop router: 

• selecting among other possible next hop routers, a next hop router for which the 
transmission of the datagram on the link connecting said next hop router, would 
not result for the current bandwidth usage in exceeding the current bandwidth 
threshold associated with said next hop router; 
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• updating the current bandwidth usage associated with the selected next hop 
router; 

• transmitting the datagram to the selected next hop router. 

In a particular embodiment, the step of selecting among other possible next hop 
5 routers, a next hop router for which the transmission of the datagram on the link 
connecting said next hop router, would not result for the current bandwidth usage in 
exceeding the current bandwidth threshold associated with said next hop router, 
comprises the further steps of : 

if, among other next hop routers, no next hop router for which the transmission of 
10 the datagram on the link connecting said next hop router would not result for the 
current bandwidth usage in exceeding the current bandwidth threshold associated 
with said next hop router, can be selected: 

• choosing among all possible next hop routers, a next hop router; 

• updating the current bandwidth threshold associated with this next hop router 
15 with the next value in a list of bandwidth thresholds; 

if the transmission of the datagram on the link connecting the chosen next hop 

routery would not result -for a-current- bandwidth usage- in-exceeding the- updated 

current bandwidth threshold associated to said next hop router; 

• updating the current bandwidth usage associated with the chosen next hop 
20 router; 

• transmitting the datagram to the chosen next hop router. 

Further embodiments of the invention are provided in the appended dependent 
claims. 

The foregoing, together with other objects, features, and advantages of this 
25 invention can be better appreciated with reference to the following specification, 
claims and drawings. 
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Brief d scription of the drawings 

The novel and inventive features believed characteristics of the invention are set 
forth in the appended claims. The invention itself, however, as well as a preferred 
mode of use, further objects and advantages thereof, will best be understood by 
S reference to the following detailed description of an illustrative detailed embodiment 
when read in conjunction with the accompanying drawings, wherein : 

• Figure 1 is a general view of a networl< comprising a source network and a 
plurality of destinations networks interconnected by means of routers. 

• Figure 2 is a typical view of a server hosting centre connected to two different 
0 Internet Service Providers (ISPs). 

• Figure 3 is a flow chart showing different steps of the method of routing an IP 
datagram in a router according to prior art. 

• Figure 4 shows a Forwarding Information Base (FIB) and an associated Layer 2 
Table used for routing IP datagrams according to prior art. 

5 • Figure -5a shows a packet based traffic on a link. ~ --r- - 

• Figure 5b shows the sampling of a packet based traffic on a link. 

• Figure 5c is a microscopic view of a bandwidth usage on a link. 

• Figure 5d is a macroscopic view of a bandwidth usage on a link. 

• Figure 6 shows the algorithm used by Internet Service Providers for billing 
3 bandwidth. 

• Figure 7 shows a Forwarding Information Base (FIB) and an associated Layer 2 
Table used for routing IP datagrams according to the present invention. 
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• Figure 8 shows the current bandwidth for billing as a function of the time on two 
different links according to the bandwidth thresholds defined for each link. 

• Figure 9 is a flow chart showing different steps of the method for selecting a link 
to route a datagram to a next hop router according to the present invention, 

5 • Figure 10 shows a Forwarding Information Base (FIB) and an associated Layer 2 
Table used for routing IP datagrams according to a particular embodiment of the 
present invention. 

• Figure 1 1 is a flow chart showing different steps of the method for selecting a link 
to route a datagram to a next hop router according to a particular embodiment of 

10 the present invention. 

Preferred embodiment of the invention 

PRIOR ART 
General View 

" - Before going into the details of specific embodiments, 'it will be helpful to understand 

15 from a more general perspective the various elements and methods which may be 
related to the present invention. 

Figure 1 is a general view of a network comprising a source network (100) 
connected to three destinations networks (105) through a locally attached router 
(101) and a plurality of remote routers (102, 103 and 104). Said routers exchange 
20 routing information related to the different destination networks using any kind of 
routing protocol. A destination network may be either directly attached to the remote 
routers or attached to different layers of routers which are in turn connected to the 
remote routers (this last configuration does not affect the present invention). 
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A cost value is associated with each link between the routers. In the present 
example, it is supposed that the link between router 101 and router 102 has a cost 
of 1, the link between router 101 and router 103 has a cost of 2, and the link 
between router 101 and router 104 has a cost of 3. The links between the routers 
5 102, 103,104 and the destination networks have all a cost of 1 . 

• Destination Network 1 can be reached from router 101 through router 102 (the 
total cost is then 1 +1 =2) or through router 1 03 (the total cost is then 2+1 =3) or 
through router 104 (the total cost is then 3+1=4). 

• Destination Network 2 can be reached from router 101 through router 102 (the 
10 total cost is then 1 +1 =2) or through router 1 04 (the total cost is then 3+1 =4). 

• Destination Network 3 can be reached from router 101 through router 103 (the 
total cost is then 3+1=4). 

Typical Configuration 

Figure 2 shows a typical configuration where a Server Hosting Centre (200) is 
15 connected to two different Internet Service Providers : ISP-1 (201) and ISP-2 (202). 
In the server hosting centre, for redundancy reasons, two front end routers (203 and 
204) are used to connect the routers (205 and 206) of the Internet Service Providers 
(201) (202). In the present configuration, the Border Gateway Protocol (BGP) (207) 
is used by the different routers (203, 204, 205 and 206) to advertise a!! thednternet 
20 routes and networks. The routes and networks advertisements are dynamically 
stored in the routing table of each router. The IP datagrams are routed towards their 
final destination network by the routing devices, at the front end of the server hosting 
center. The routing is mostly executed according to the criterion of the shortest path. 

Routing Table and Forwarding Information Base 

25 According to prior art, the process for routing IP datagrams is based on the routing 
table or on a subset of said routing table commonly called Forwarding Information 
Base (FIB). While the routing table contains routing information that may never be 
used, the Fonwarding Infomiation Table (FIB) contains routing information for a 
destination network to which an IP datagram has already been routed. When an IP 

30 datagram is received, the router creates an entry in the Forwarding Information Base 
(FIB) including the following information : 
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• an identification of the destination network, and 

• an identification of the next hop router to reach this destination network. 

As shown in Figure 4, the basic information In the Forwarding Information Base (FIB) 

(404) is a list of destination networks (405), each destination network being identified 
with an IP address, and each IP address being associated with a next hop router 
(NH) (406)- The full routing table (400) associates : 

• with each destination network (401), all the possible next hop routers (402) and 

• with each next hop router (402) a distance (or cost) (403). 

while the FIB associates with each destination network, only one next hop router 
(NH), generally the next hop router (NH) with the lower associated cost. 

Each IP datagram to route contains a destination network IP address. The router 
searches in the FIB, the IP address of the next hop router associated with this 
destination network IP address. The FIB comprises for each destination network 

(405) IP address : 

• the IP address (NH-102 or NH"104)(406) of the next hop router (NH); and 

• the associated layer 2 header of the next hop router (NH), In a preferred 
embodiment, the FIB comprises a pointer to an entry in a Layer 2 Table (407), 
said entry comprising the layer 2 header for identifying the next hop router (NH). 

The layer-24s-also called MAG or Medium Access Control layer In-the OSI model. 

The layer 2 header (also called MAC header) comprises the physical hardware 
address (also called MAC address) of the next hop router. 

Routing 

As shown in Figure 3, the method for routing an IP datagram according to prior art 
comprises the steps of : 

• (300): receiving an IP datagram and identifying the destination network IP 
address of this IP datagram. 

• (301): retrieving : 

• from the FIB, the IP address of the next hop router (NH) associated with the 
destination network address of the IP datagram; and 
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• from the associated Layer 2 Table, the next hop layer 2 header, said header 
comprising the physical hardware address (also called MAC address) of the 
next hop router. 

• (302): updating the header of the IP datagram with the next hop (NH) layer 2 
5 header previously retrieved. 

• (303): sending the IP datagram with the updated header to the next hop router 
(NH). 

BANDWIDTH PRICING MODEL 

The pricing model exercised by the Internet Service Providers (ISPs) can consist in 
10 a fixed price corresponding to a committed rate, paid whether it is used or not. It can 
also be based on a bandwidth usage calculated from periodical sampling of the 
traffic during the billing period. Or it can be a mix of the two, with a guaranteed part 
that is always paid and a variable part that is charged depending on the bandwidth 
usage. 

15 Terminology and Assumptions 

• P : Billing period. Usually one month. 

• N : Number of bytes emitted (or received) over the billing period P. 

• L : Physicalline speed: - ^ - 

• T : Observation period for traffic sampling. A common value is 5 minutes. 

20 • K-P/T = The number of observation periods in the billing period. Typically, for 
P = 1 month and T = 5 minutes, K is 8640 for a month of 30 days. 

• Bb = Bandwidth value chosen for billing (for instance, a customer or a Server 
Hosting Centre when the bandwidth is provided by an Internet Service Provider). 

To simplify, it is assumed that at the beginning of each billing period P, each 
25 structure holding data, like counters or sets of bandwidth values, is reset to zero. 

Traffic 

From a mathematical point of view, a packet based traffic like IP is a succession of 
data bursts emitted at line speed. The traffic is mainly characterised by : 

• the length of data bursts (datagram size), and 
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• the inter-spacing between data bursts (datagram rate). 
Such a traffic is described by a series of events (f/, cfn/), where 

• ti is within the billing period P (to < t < tpwith tp - to = P), and 

• drii is a positive non zero integer. 

A series of events (&, dn) corresponds to the time ti at which a datagram of size drif 
bits begins its transmission on the line (or the time at which full reception terminates 
depending on the observation point). By cumulating the events, as shown in Figure 
5a, this results in a curve n^'f^with the following properties : 

• n(to) = 0 bits and n(tp) = N bits, 

• t is within the billing period P, 

• n(t) values are positive integers, 

• n(t) is a non continuous function (and cannot be derived). 
Traffic Observation - Sampling 

Routers and other network data devices do not provide n(t)- It would be too costly in 
temns of memory and processing time. Instead, they provide sets of counters, for 
instance for counting the number of transmitted bits (or received bits). Consequently, 
traffic Is observed by regularly sampling the values of these counters. As shown in 
Figure 5b, this is represented by a series V of K+1 terms Vo, Vi, vk, where : 

• K = PyT; 

ti = i.T; - - • - ^ ^- ■ ■ . 

• i is a positive integer e [0, K]; 

• Vi = n(i.T). It is easy to see that Vo = 0 and vk= N. 

Bandwidth Usage 

• Microscopic view : Since data is emitted at line speed L, the curve of the 
bandwidth usage as shown in Figure 5c, comprises a succession of intervals with 
a bandwidth value equal to L and a length equal to the size of the datagram that 
is transmitted, spaced by intervals of zero bits per second. 

• IVIacroscopIc view : This view considers that the bandwidth used over a short 
period of time T, is equal to the amount of data transmitted during this period of 
time divided by T. To avoid any micro aspect of the bandwidth usage curve, the 
period of time T is chosen sufficiently long compared to the time required to 
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transmit on the line a datagram at speed L. Practically, the macroscopic curve of 
the bandwidth usage as shown In Figure 5d is built using the regularly observed 
samples of n(t) mentioned previously. The curve can be represented by a series 
U of K terms ui, uk. where Ui = (vi - vm)/T (in bits per second). This 
5 macroscopic curve (shown in Figure 5d) represents the density of the 
microscopic curve (shown in Figure 5c) with regard to the observation intervals, 
and when T 0, the preceding microscopic view is retrieved. 

For a single traffic curve n(t), even when considering only T such as PU = K is a 
positive non zero integer, there are an infinity of possible bandwidth usage curves. 
10 Practically, T must be sufficiently long to avoid micro effects, and not too short 
compared to the billing period P so that the amount of accumulated data, and the 
traffic generated to get them, are manageable. T must not be too long in order to 
see bursts of data packets. As said before, it is frequent to have T = 5 minutes and 
K = 8640 numbers to store over a period of 30 days, 

IS Bandwidth for Billing 

The next logical step after gathering bandwidth usage data is to compute a 
bandwidth value Bb for billing. The algorithm to compute the value Bb is generally 
chosen as : 

• being calculable; ----- 

20 • producing a number that takes into account bursts; 

• not being too complex; 

• being understood. 

• Mean value over the billing period 

For instance, a simple algorithm consists in computing Bb equal to N/P. In this 
25 particular case, Bb is only a mean value which does not takes into account the 
bursts or more generally of the bandwidth usage. A customer can concentrate all 
his traffic on the first days of the billing period or on specific hours of the day and 
can do nothing the rest of the time or just have a regular flat traffic during the 
whole billing period : the value Bb will be the same. 
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• Bandwidth usage 

The algorithms used by the Internet Service Providers are frequently based on 
the bandwidth usage observed during the billing period. In this case and as 
shown in Figure 6, the bandwidth for billing Bb is a function f of the series U 
defined previously : 

Bb = f(ui, uk) . The algorithm for computing Bb can be based either on all the 
values Ui of the series U (weighted average algorithm) or on only a limited set of 
values (95 or 90 percentile algorithm). 

• 95 or 90 percentile 

A percentile is a value on a scale of one hundred that indicates the percent of a 
distribution that is equal to or below it. The bandwidth 95 or 90 percentile of the 
traffic observed during the billing period is calculated from the bandwidth usage 
curve. An ordered series S of K terms Si, Sk is built where : 

• S is a permutation of the series U (previously defined); 

• V (i„j) e [1,...,K]^ for i<j, Si < Sj. 

A simple definition of the 95 percentile is the following : Bbss = Se[o.9sk]4^i, where 

• E[x] is the integer part of x (x being a real number). 

In the literature, the following definitions can also be found : 

• Bb95 = Se[0.95K], or 

Bb95 = (E[0.95K] + 1 - 0- 95K);se[o.95ki + (0.95K - E[0-95K]).Se[oWi, which is a 

linear interpolation between two values. 
The bandwidth value for billing according to the 95 or 90 percentile algorithm as 
used by most Internet Service Providers (ISPs) : 

• is simple to compute, 

• is not too expensive to process, 

• is difficult to anticipate for the customer, 

• depends on 5% of the traffic. The remaining traffic has not impact on the 
billing. 

Weighted average 

This method computes a value Bb from the bandwidth usage series U by 
assigning a weight wi to each bandwidth value Ui. This is expressed as: 
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Assigning a same weight to each bandwidth value is equivalent of calculating a 
mean value. In general, the cost is a function of the bandwidth value. Many 
possibilities can be considered such as : 
5 • defining the weight as an increasing function of the bandwidth value to give 
more importance to the highest bursts that consume more resources, 
• defining the weight as equal to the bandwidth value : 




The value Bb : 

10 • can be easily computed since it only relies on additions and multiplications, 

• is easily understandable, and 

• takes into account both burst periods and periods where the traffic is low. 



INVENTION 



The present invention is directed to computer networks, and more particularly to a 
15 method and system, in an Internet Protocol (IP) network, for routing IP traffic to 
several next hop routers according to current bandwidth usage on links connecting 
these next hop routers. The object of the present invention is to change the routing 
decision process executed in the routers so that the decision does not only depend 
on a distance or cost to a destination network but also depends on a bandwidth 
20 usage as billed by Internet Services Provides (ISPs) on the links to next hop routers. 

Forwarding Information Base 

Referring to prior art, the Forwarding Information Base (FIB) comprises for each 
destination network : 

• the IP address of the next hop router (NH); and 
25 • the associated layer 2 header of the next hop router (NH). 



According to the present invention, as described in Figured 7, for each link to next 

—Op router ^NH\ additicna! information is used to route traffic i 
• a current bandwidth for billing (701); 
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• a list of bandwidth thresholds (702); 

• a current bandwidth threshold (703); 

• a billing period (704). 

In a preferred embodiment, the additional information (700) is stored in the 
5 Forwarding Information Base (FIB). In a particular embodiment this information is 
stored In the Layer 2 Table associated with the Forwarding Information Base (FIB). 

Current bandwidth for billing 

The current bandwidth for billing (701) on the link li connecting the next hop router 
(NHi) is computed each time a new datagram must be transmitted. The current 
10 bandwidth for billing Bbc can be defined as : 

• being equal to the bandwidth for billing Bbat time tc or 

• being an approximation of the bandwidth for billing Bb at time tc- 

In particular, the current bandwidth for billing Bbc can be defined as a function f" of a 
series of K terms ui,...,Ue[c], u'elc^i, wherein : 

• tc is within the billing period P; 

• c is a real number comprised between 0 and K (0 < c < K); 

• E[c] is the integer part of c; 

• 'td + T;E[c]^ tc < to +T;(E[c] + 1) - - " 

• the series Ui,...,Ue[c] comprises the first E[cl terms of the series U. 

• the term u EtcKi is function of the datagrams transmitted during the time interval : 

tE(cl<t <tc. 

The current bandwidth for billing can be defined as equal to Bbc = t'(Ui,..-,UErc3, 
u'e[c]+i) wherein: 

• the function f increases with the time within the billing period. 

25 • Bbc for tc == tp is lower or equal to the bandwidth for billing Bb : f(ui,-..,UK) < f 

(Ui,...,Uk)- 

For instance, the value Bbc according to the mean value algorithm can be defined as 
equal to : 
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Bbc = [(ui + .... + Ue[c3) + (u'eio+i)] / K = Nc/P wherein 

• Nc = number of bits corresponding to datagrams tliat have been transmitted 
during the time period between to and the current time tc (Nc < N). 

• P = billing period. 

5 It Is easy to see that the minimum bandwidth for billing (Bbc = Nc/P) is an increasing 
function with the time. 

List of bandwidth thresholds 

The list of bandwidth thresholds (702) on the link li connecting the next hop router 
(NH|) is a configured set of values based on the pricing model of the Internet Service 

10 Provider. At the end of the billing period, once the bandwidth for billing B'b (which is 
an indication of the bandwidth usage) is calculated, a contractual price (or cost) is 
applied. A contractual price for a predefined bandwidth interval is a fixed price 
applied by the Internet Service Provider whatever the value of the bandwidth for 
billing is within this predefined bandwidth interval. As the pricing model of most 

15 Internet Sen/ice Providers is based on a plurality of contractual prices Cthj depending 
on the bandwidth usage, several different bandwidth thresholds are defined. For 
instance, for link h, a first contractual price "CW can be applied for values of B'b 
between 0-10 Mbps, a second contractual price "CW" can be applied for a value of 
B*b between 10-20 Mbps, and a third contractual price "CW can be applied for a 

20 value of B*b between 20-30 Mbps, etc In this example, the foltowing bandwidth ^ ^^'^^^ 
threshold are defined : B'mi = 10 Mbps. B'th2 = 20 Mbps, B'ths = 30 Mbps, etc ... Each 
time the bandwidth value for billing B'b will exceed a given bandwidth threshold, a 
different contractual price will be applied by the Internet Service Providers. For 
instance, if, at the end of the billing period, BVi < B'b <. B'thj , then the total price to 

25 pay will be equal to C*thj. 

Current bandwidth threshold 

The current bandwidth threshold (703) on the link Ij connecting the next hop router is 
a variable which can only take discrete values comprised in the list of bandwidth 
thresholds. If the list of bandwidth thresholds comprises the values : {B'thi = 10, B*th2 = 
30 20, B*»ha = 30}, the current bandwidth threshold can only take the values 10, 20 and 
30 Mbps. 
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♦ At the beginning of the billing period, the current bandwidth threshold is 
defined equal to the first (lowest) value in the list of bandwidth thresholds. 

• If the transmission of a new datagram results in exceeding the current 
bandwidth threshold of each link, the algorithm, according to the present 

5 invention, selects a link and the current bandwidth threshold of this selected 

link is set equal to the next value in the list of bandwidth thresholds. 

Billing period 

The billing period (704) is a configured value (for example 1 month) based on the 
pricing model of the Internet Service Provider on the link to the next hop router. 

10 Routing according bandwidth usage 

The pricing model of most Internet Service Providers divides the bandwidth in 
several contiguous intervals and associates a contractual price with each of these 
bandwidth intervals. For instance, on link li, a cost Cmi is associated with bandwidth 
interval 0-10 Mbps, a cost CW with interval 10-20 Mbps, a cost C*th3 with interval 
15 20-30 IS/lbps, etc ... In the present example, the list bandwidth thresholds values for 
link ii to next hop router NHi, comprises the following values : B'un = 10 Mbps, BW = 
20 Mbps, B'th3 = 30 Mbps, etc ... 

According to the present invention; at the beginning of the billing period, the current 
bandwidth thresholds of the links connecting the various next hop routers are 

20 initialized with the first value B'thi (10 Mbps) in the lists bandwidth thresholds. Up to 
the current bandwidth threshold B\hi (from 0 to 10 Mbps), a first next hop router 
(NHI) is used to route the datagrams. Once the current bandwidth for billing B^bc has 
reached this current bandwidth threshold B\hi(10 Mbps) with this first next hop router 
(NHI), a second next hop router (NH2) is used. However, the current bandwidth for 

25 billing B^bc of the link U connecting this second next hop router NH2 must also be 
taken into account. If the current bandwidth threshold B^thi for this second next hop 
router NH2 is reached, the next hop router NHI can be selected again until the 
second bandwidth threshold B\h2 of NHI (20 Mbps in the example) is reached and so 
on. 
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The mechanism previously described is illustrated in Figure 8. The graphic shows 
the current bandwidth for billing (B^bc & B^bc) (800) on each link as a function of the 
time t (805). In the present example, the current bandwidth for billing is defined as 
an increasing function. On the Bandwidth line (y-axis), the first two bandwidth 
thresholds (B^mi & BV) for link h (801 & 804) and the first two bandwidth thresholds 
(B^hi & B^ths) for link I2 (802 & 803) are shown. 

• At time (806), a first datagram must be routed. The list of possible next hop 
routers (NH) is in the Routing Table with the associated "costs" or "distances". In 
a preferred embodiment, the next hop router with the lowest cost or shortest 
distance is selected. In the present example, the first datagram is routed on link 
h. The current bandwidth for billing BV on link li increases but remains below the 
current bandwidth threshold B\hi defined for link h. 

• At time (807), a new datagram is routed on link li. The current bandwidth for 
billing B^bc on link h increases but remains below the current bandwidth threshold 
BVi defined for link I1. 

• At time (808), a new datagram must be routed. The current bandwidth for billing 
BV on link U is estimated taking into account the transmission of this new 
datagram. The estimated current bandwidth for billing BV is then compared with 
the current bandwidth threshold BVi defined for the link U. As the transmission of 
this new datagram on link h would result for the current bandwidth for billing BV 
in exceeding the current bandwidth threshold B^thi defined for link h, link I2 is 
chosen to route the datagram. The current bandwidth for billing on link I2 is 
calculated with this new datagram and increases. However, it remains below the 
current bandwidth threshold B^mi defined for link I2. 

• At time (809), a new datagram is routed on link I2. The current bandwidth for 
billing BV on link I2 increases but remains below the current bandwidth threshold 
B^iM defined for link I2. 

• At time (810), a new datagram must be routed. The current bandwidth for billing 
BV on link I2 is estimated taking into account the transmission of this new 
datagram. The estimated current bandwidth for billing BV is then compared with 
the current bandwidth threshold B^thi defined for the link I2. As the transmission of 
this new datagram on link I2 would result for the current bandwidth for billing BV 
in exceeding the cun^ent bandwidth threshold B^mi defined for link I2, link h is 
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chosen again to route the datagram. The current bandwidth for billing on link U is 
calculated with this new datagram and increases. However, it remains below the 
current bandwidth threshold B\hi defined for link U. 
• At time (81 1 ), a new datagram must be routed, 

• The current bandwidth for billing B^bc on link U is estimated taking into account 
the transmission of this new datagram. The estimated current bandwidth for 
billing B^bc is then compared with the current bandwidth threshold B\hi defined 
for the link li. The transmission of this new datagram on link li would result for 
the current bandwidth for billing B^bc in exceeding the current bandwidth 
threshold B\hi defined for link li. 

• The current bandwidth for billing B^bc on link k is estimated taking into account 
the transmission of this new datagram. The estimated current bandwidth for 
billing B^bc is then compared with the current bandwidth threshold B^thi defined 
for the link The transmission of this new datagram on link I2 would also 
result for the current bandwidth for billing B^bc in exceeding the current 
bandwidth threshold B^thi defined for link I2. 

As the current bandwidth for billing of each link (both links I1 and I2) has reached 
the value of the first bandwidth threshold in its list of bandwidth thresholds, a link 
(in this example link I1 again) is chosen in the set of possible links for routing the 
datagram. The current bandwidth threshold of link I1 is set equal to the next value 
B^th2 in the list. The current bandwidth for billing on link ii increases while 
remaining below the updated current bandwidth threshold (which is now B^tha). 
• At time (81 2). a new datagram must be routed. 

• The current bandwidth for billing B^c on link h is estimated taking into account 
the transmission of this new datagram. The estimated current bandwidth for 
billing B\c is then compared with the current bandwidth threshold B\h2 
previously defined for the link h. The transmission of this new datagram on 
link h would result for the current bandwidth for billing B^bc in exceeding the 
current bandwidth threshold B^tna defined for link li. 

• The current bandwidth for billing B%c on link I2 is estimated taking into account 
the transmission of this new datagram. The estimated current bandwidth for 
billing B^bc is then compared with the current bandwidth threshold B^thi 
previously defined for the link I2- The transmission of this new datagram on 
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link I2 would result for the current bandwidth for billing B%c in exceeding the 

current bandwidth threshold B^thi defined for link I2. 
In the present exannple, link I2 is chosen for routing the datagram. The current 
bandwidth threshold of link la is set equal to the second value B^tha in the list. The 
current bandwidth for billing on link I2 increases while remaining below this new 
defined current bandwidth threshold (which is now B^tna). 

• At time (813) a new datagram must be routed. The current bandwidth for billing 
B^bc on link I2 is estimated taking into account the transmission of this new 
datagram. The new estimated current bandwidth for billing B^bc is then compared 
with the current bandwidth threshold B^ma defined for the link I2. The transmission 
of this new datagram on link I2 would result for the current bandwidth for billing 
B^bc in exceeding the current bandwidth threshold B^h2 defined for link I2. Link U is 
chosen again to route the datagram. The current bandwidth for billing on link I1 
increases but remains below the current bandwidth threshold BW defined for link 
I1. 

Link Selection Aigoritiim 

As described In Figure 9, according to the present invention, steps (900) to (913) are 
added after the next hop router has been found in the Forwarding Information Base 
(FIB) : 

• (300): upon reception of an IP datagram, searching in the FIB, the entry 
corresponding to the destination network address of the IP datagram. 

• (301): retrieving : 

• from the FIB, the IP address of the next hop router (NHi) associated with the 
destination network address; and 

• from the associated Layer 2 Table, the layer 2 header corresponding to the 
next hop router (NHi). 

• (900): checking whether or not the bandwidth usage of link h connecting the next 
hop router (NHi) must be taken into account for routing this IP datagram. In 
general, the bandwidth usage of a link is considered : 

• as important when what is billed is a function of this bandwidth usage. 

• as not important either when what is billed is not a function of the bandwidth 
usage or when the bandwidth usage is free. 
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• (913): if the bandwidth usage of the link 1} connecting the next hop router (NH|) 
must not be taken into account, sending the IP datagram to the next hop router 
(NHj) (with the layer 2 header of the next hop router (NHi)) according to steps 
(302) and (303). 

• (901): if the bandwidth usage of the link li connecting the next hop router (NH|) 
must be taken into account, determining whether or not the IP datagram can be 
sent to this next hop router (NHi) : 

• (902): retrieving the current bandwidth for billing B'bc of the link li from the FIB; 
and 

estimating the current bandwidth for billing B'bc taking into account the IP 
datagram to transmit. 

• (903): retrieving the current bandwidth threshold B'mc of link li from the FIB; 
and 

comparing the estimated current bandwidth for billing B'bc with the retrieved 
current bandwidth threshold BW: 

• (904): if the estimated current bandwidth for billing does not exceed the 
current bandwidth threshold, in another words, if the transmission of the IP 
datagram on link \\ would not result for the current bandwidth for billing B'bc 
in exceeding the current bandwidth threshold BW: 

• (905) updating in the FIB, the current bandwidth for billing with the 
- - estimated bandwidth for-billlng. The process goes on with steps- (302) 

and (303). 

• (906): if the estimated current bandwidth for billing exceeds the current 
bandwidth threshold, in another words, if the transmission of the IP 
datagram on link ii would result for the current bandwidth for billing B^bc in 
exceeding the current bandwidth threshold BW : 

• (907) checking whether or not another link Ij to another next hop router 
(NHj) can potentially route the datagram without exceeding the 
associated current bandwidth threshold. The list of possible links Ij or 
next hop routers (NHj) is in the Routing Table with the associated costs 
or distances. 

• (908): if one or a plurality of next hop routers (NHj) can potentially 
route the IP datagram without exceeding the current bandwidth 
threshold on link I] : 
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• (909): selecting among the one or a plurality of next hop routers 
(NHj) that can potentially route the IP datagram, a next hop 
router (NH). This next hop router is generally chosen according 
to the associated cost or distance (lowest cost or shortest 

5 distance). 

• going back to step (900). 

• (910): if no next hop router (NHj) can route the IP datagram without 
exceeding the current bandwidth threshold on link Ij : 

• (911): selecting among all next hop routers, a next hop router 
10 (NH). This next hop router is generally chosen according to the 

associated cost or distance (lowest cost or shortest distance). 

• (912) updating in the FIB, the value of the current bandwidth 
threshold with the next value in the list of bandwidth thresholds 
associated with this next hop router. 

15 • going back to step (900). 

• (302): updating the output IP datagram header with the layer 2 header of the 
selected next hop router. 

• (303): sending the IP datagram with the updated header to the selected next hop 
router. 

20 Particular embodiment . . 

As shown in Figure 10, according to a particular embodiment of the present 
invention, the following new information (1000) is added In the FonA^arding 
Information Base (FIB) for each link to next hop router (NH) : 

• a minimum time to emit next datagram (1001); 
25 • a list of bandwidth thresholds (1002); 

• a current bandwidth threshold (1003); 

• a billing period (1 004). 

Minimum Time to Emit Next Datagram 

This value is dynamically computed by the the router each time a new datagram 
30 must be sent. The Minimum Time to Emit Next Datagram MTENDnew Is defined as 
being equal to the previous Minimum Time to Emit Next Datagram MTENDprev (in 



FR9-2002-0058 



26 



seconds) plus the size of the datagram dn (in bits) to emit divided by the current 
bandwidth threshold Bthc of the link I to the next hop router (NH) : 

new Minimum Time to Emit Next Datagram = previous Minimum Time to Emit 
Next Datagram + Datagram-Size / Current Bandwidttt Tliresfiold. 

5 MTENDn^i = MTENDn + dnn+i/Bthc(n+i) ; 

MTENDn+1 = MTENDo + dni/Bthci + ... + dnk/Bmck + ... dnn/Bthcn + dnn+i/Bthc(n+i) ; 
with : 

• n = number of emitted datagrams; 

• MTENDo = to ; 

10 The term dnn/Bmcn (size of the nth datagram divided by current bandwidth threshold) 
is equal to the minimum time it takes to transmit a datagram of a given size (dnn) 
without exceeding the current bandwidth threshold (Bthcn). The term dnn/Bthcn is also 
equivalent to the time it takes to transmit the same datagram at a speed equal to the 
current bandwidth threshold (Bthcn). 

15 The Minimum Time to Emit Next Datagram is equal to the time before which all 

datagrams will be transmitted without' exceeding the different current bandwidth 

thresholds. To compute the Minimum Time to Emit Next Datagram, the time periods 
for transmitting each datagram, are cumulated from the starting time to of the billing 
period P. 

20 Link selection algorithm 

i 

The link selection algorithm as described in Figure 1 1 , comprises the steps of: 

• (300): upon reception of an IP datagram, searching in the FIB, the entry 
corresponding to the destination network address of the IP datagram. 

• (301): retrieving : 

25 • from the FIB, the IP address of the next hop router (NHi) associated with the 
destination network address; and 
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• from the associated Layer 2 Table, the layer 2 header corresponding to the 
next hop router (NHi). 

• (1100): checking whether or not the bandwidth usage of link li connecting the 
next hop router (NHi) nnust be taken into account for routing this IP datagram. In 
general, the bandwidth usage of a link is considered : 

• as important when what is billed is a function of this bandwidth usage. 

• as not important either when what is billed Is not a function of the bandwidth 
usage or when the bandwidth usage is free. 

• (1113): if the bandwidth usage of the link \\ connecting the next hop router (NHi) 
must not be taken into account, sending the IP datagram to the next hop router 
(NHi) (with the layer 2 header of the next hop router (NH|)) according to steps 
(302) and (303). 

• (1101): if the bandwidth usage of the link li connecting the next hop router (NHi) 
must be taken into account, determining whether or not the IP datagram can be 
sent to this next hop router (NHi) : 

• (1 102): retrieving the current time (maintained by the operating system of the 
router); and 

• (1103): retrieving from the FIB, the current Minimum Time to Emit Next 
Datagram of link h ; and 

comparing the current time with the current Minimum Time to Emit Next 

Datagram. ^ ^ . 

• (1 104): if the current time is greater than or equal to the current Minimum 
Time to Emit Next Datagram for link li, it remains time to send the present 
IP datagram on link li without exceeding the current bandwidth threshold : 
• (1 105): computing the new Minimum Time to Emit Next Datagram; and 
updating the FIS with this new Minimum Time to Emit Next Datagram. 
The new Minimum Time to Emit Next Datagram is equal to the current 
Minimum Time to Emit Next Datagram (in seconds) plus the size of the 
datagram (in bits) divided by the current bandwidth threshold of the link 
li: 

New Minimum Time to Emit Next Datagrams current ll/linimum 
Time to Emit Next Datagram + Datagram-Size/Current Bandwidth 
Ttirestioid. 
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The process goes on with steps (302) and (303). 
• (1 106): if the current time is lower than the current Minimum Time to Emit 
Next Datagram for link h, there is no time available to send the present IP 
datagram on link h without exceeding the current bandwidth threshold. 
5 Another link to another next hop router (NH), or another current bandwidth 

threshold must be selected. 

• (1107) checking whether or not another link Ij to another next hop 
router (NHj) can potentially route the datagram without exceeding the 
associated current bandwidth threshold. The list of possible links Ij or 
10 next hop routers (NHj) is in the Routing Table with the associated costs 

or distances. 

• (1 108): if one or a plurality of next hop routers (NHj) can potentially 
route the IP datagram without exceeding the current bandwidth 
threshold on link Ij : 

15 • (1109): selecting among the one or a plurality of next hop 

routers (NHj) that can potentially route the IP datagram, a next 
hop router (NH). This next hop router is generally chosen 
according to the associated cost or distance (lowest cost or 
shortest distance). 
20 • going back to step (900). 

- • - (1 1 1 0): If no next hop router (NHj) can route the IP datagram - 

without exceeding the current bandwidth threshold on link Ij : 

• (1111): selecting among all next hop routers, a next hop router 
(NH). This next hop router is generally chosen according to the 

25 associated cost or distance (lowest cost or shortest distance). 

• (1112) updating in the FIB, the value of the current bandwidth 
threshold with the next value in the list of bandwidth thresholds 
associated with this next hop router. 

• going back to step (1 100). 

30 • (302): updating the output IP datagram header with the layer 2 header of the 
selected next hop router. 
• (303): sending the IP datagram with the updated header to the selected next hop 
router. 
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In prior art, the decision for routing a datagram to a destination network was always 
based on the shortest path. The shortest path is in fact a cost to reach a destination 
network. This cost is static (pre-defined). In the present invention, the shortest path 
is still taken into account but the routing decision is also based on the bandwidth 
5 usage (or current bandwidth for billing) of the link to the next hop router. The 
bandwidth usage (or current bandwidth for billing) is a dynannic parameter which is 
updated in the FIB extension in real-time. 



While the invention has been particularly shown and described with reference to a 
preferred embodiment, it will be understood that various changes in form and detail 
10 may be made therein without departing from the spirit, and scope of the invention. 
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Claims 

What we claim is: 

1. A method in a router in an IP network, for selecting a next hop router among a 
plurality of next hop routers according to bandwidth usage of links connecting said 
5 plurality of next hop routers, said method comprising the steps of : 

• receiving a datagram comprising a destination network address; 

• identifying a next hop router associated with said destination network address; 

• determining whether or not the transmission of the datagram on the link 
connecting the next hop router would result for a current bandwidth usage in 

10 exceeding a current bandwidth threshold associated with said next hop router: 

if the transmission of the datagram on the link connecting the next hop router, would 
not result for the current bandwidth usage in exceeding the current bandwidth 
threshold associated with said next hop router; 

• updating the current bandwidth usage associated with the next hop router; 
15 • transmitting the datagram to the next hop router; 

If the transmission of the datagram on the link connecting the next hop router would 
result for the current bandwidth usage in exceeding the current bandwidth threshold 
associated with said next hop router: 

• selecting among other possible next hop routers, a next hop router for which the 
20 transmission of the datagram on the link connecting said next hop router, would 

not result for the current bandwidth usage in exceeding the current bandwidth 
threshold associated with said next hop router; 

• updating the current bandwidth usage associated with the selected next hop 
router; 

25 • transmitting the datagram to the selected next hop router. 



FR9-2002-0058 



31 



2. The method according to the preceding claim wherein the step of selecting among 
other possible next hop routers, a next hop router for which the transmission of the 
datagram on the link connecting said next hop router, would not result for the current 
bandwidth usage in exceeding the current bandwidth threshold associated with said 
5 next hop router, comprises the further steps of : 

if, among other next hop routers, no next hop router for which the transmission of 
the datagram on the link connecting said next hop router would not result for the 
current bandwidth usage in exceeding the current bandwidth threshold associated 
with said next hop router, can be selected: 

10 • choosing among all possible next hop routers, a next hop router; 

• updating the current bandwidth threshold associated with this next hop router 
with the next value in a list of bandwidth thresholds; 

if the transmission of the datagram on the link connecting the chosen next hop 
router, would not result for a current bandwidth usage in exceeding the updated 
15 current bandwidth threshold associated to said next hop router; 

• updating the current bandwidth usage associated with the chosen next hop 
router; . * . 

• transmitting the datagram to the chosen next hop router. 

3- The method according to any one the preceding claims wherein the step of 
20 determining whether or not the transmission of the datagram on the link connecting 
the next hop router would result for a current bandwidth usage in exceeding a 
current bandwidth threshold associated with said next hop router, comprises the 
steps of: 

• retrieving from a table, the current bandwidth usage associated with the next hop 
25 router, said table comprising for each next hop router, a current bandwidth usage 

on the link connecting said next hop router; 

• estimating the current bandwidth usage taking into account the transmission of 
the datagram on the link connecting the next hop router; 
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• retrieving from the table, the current bandwidth threshold associated with the 
next hop router, said table comprising for each next hop router, a current 
bandwidth threshold for the link connecting said next hop router, said current 
bandwidth threshold taking discrete values comprised in a list of bandwidth 

5 thresholds; 

• comparing the estimated current bandwidth usage with the current bandwidth 
threshold. 

4. The method according to any one of the preceding claims wherein the step of 
updating the current bandwidth usage associated with the next hop router, 

10 comprises the step of: 

• updating in the table, the current bandwidth usage with the estimated bandwidth 
usage. 

5. The method according to claim 1 wherein said step of determining whether or not 
the transmission of the datagram on the link connecting the next hop router would 

15 result for a current bandwidth usage in exceeding a current bandwidth threshold 
associated with said next hop router, comprises the steps of: 

• determining the current time; 

• retrieving from a table, a minimum time to emit next datagram, said table 
comprising for each next hop router, an associated current minimum time to emit 

20 next datagram on the link connecting said next hop router; 

• comparing the current time with the current minimum time to emit next datagram, 

6. The method according to any one of the claims 1, 2 or 5 wherein the step of 
updating the current bandwidth usage associated with the next hop router, 
comprises the step of: 

25 • computing a new minimum time to emit next datagram equal to the current 
minimum time to emit next datagram plus the size of the datagram to transmit 
divided by the current bandwidth threshold of the link connecting the next hop 
router; 
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• updating in the table, the current mininnum time to emit next datagram with the 
computed new minimum time to emit next datagram. 

7. The method according to any one of claims 2 to 6 wherein the step of choosing 
among all possible next hop routers, a next hop router, comprises the step of: 

• choosing among all possible next hop routers, a next hop router according to a 
shortest path algorithm. 

8. The method according to any one of the preceding claims wherein the current 
bandwidth usage of a link connecting a next hop router depends on datagrams that 
have been transmitted on said link within a time period comprised between a given 
reference time and the current time. 

9. The method according to any one of the preceding claims comprising the further 
steps of : 

• computing a bandwidth for billing over a given billing period, wherein the current 
bandwidth usage computed over said billing period is lower or equal to said 
bandwidth for billing. 

1 0. A router comprising means adapted for carrying out the method according to any 
one of the preceding claims. 

11. A computer program comprising instructions for carrying out any one of steps 1 
to 9 when executed in the router according to claim 10. 
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METHOD AND SYSTEM FOR ROUTING IP DATAGRAMS 
ACCORDING TO CURRENT BANDWIDTH USAGE 

Abstract 

The present invention is directed to a method, system and computer program for 
5 selecting, in a router in an IP network, a next hop router among a plurality of next 
hop routers according to bandwidth usage of links connecting said plurality of next 
hop routers. The method comprises the steps of : 

• receiving a datagram comprising a destination network address; 

• identifying a next hop router associated with said destination network address; 

10 • determining whether or not the transmission of the datagram on the link 
connecting the next hop router would result for a current bandwidth usage in 
exceeding a current bandwidth threshold associated with said next hop router: 
if the transmission of the datagram on the link connecting the next hop router, would 
not result for the current bandwidth usage in exceeding the current bandwidth 
15 threshold associated with said next hop router; 

• updating the current bandwidth usage associated with the next hop router; 

• transmitting the datagram to the next hop router; 

if the transmission of the datagram on the link connecting the next hop router would 
result for the current bandwidth usage in exceeding the current bandwidth threshold 
20 associated with said next hop router: 

• selecting among other possible next hop routers, a next hop router for which the 
transmission of the datagram on the link connecting said next hop router, would 
not result for the current bandwidth usage in exceeding the current bandwidth 
threshold associated with said next hop router; 

25 • updating the current bandwidth usage associated with the selected next hop 
router; 

• transmitting the datagram to the selected next hop router. 
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